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INTRODUCTION 


There  is  a continuous  discussion  between  the  user  and  the  designer  as 
to  what  the  reliability  and  durability  requirements  for  a weapon  system 
should  be.  This  is  particularly  true  for  weapon  systems  which  are  pri- 
marily mechanical  such  as  howitzers.  The  user  documents  a need  (through 
the  MN  or  ROC  process)  tor  a system  possessing  reliability  and  durability 
significantly  higher  than  previous  systems.  The  designer  on  the  ocher 
hand  feels  the  user  should  accept  any  system  which  is  at  least  as  good  as 
the  existing  weapons  reliability  and  durability,  since  the  new  design  will 
undoubtedly  possess  other  characteristics  such  as  increased  range,  reduced 
weight,  etc.  which  the  designer  feels  are  the  primary  reasons  for  the  new 
system  and  are,  in  themselves,  inversely  related  to  reliability/durability. 
(He  has  never  been  asked  to  design  a totally  new  system  strictly  to 
increase  reliability  or  durability:  ) When  the  discussions  are  over  and  a 
compromise  is  reached,  the  true  benefit  of  the  agreed-to  requirement  to  the 
Army  is  questionable.  Each  side  attempts  to  provide  enough  documentation 
to  support  its  position. 

This  analysis  develops  a rationale  for  the  reliability  and  durability 
requirements  for  the  XM204,  105MM  Towed,  Howitzer  while  simultaneously 
defining  a plan  to  test  for  those  requirements.  The  system  reliability 
requirement,  subsystem  durability  requirements,  reliability  and  durabilitv 
uncertainties  of  the  proposed  design,  and  the  number  of  prototypes  and 
test  lengths  to  establish  reliability  and  durability  parameters,  are 
related  to  expected  costa. 

Certain  of  these  factors  are  identified  as  variables.  This  lends  to 
consideration  and  evaluation  of  alternative  courses  of  action  with  the 
objective  of  reducing  expected  life  cycle  costs.  The  expected  loss  (life 
cycle  cost  for  this  analysis  ) of  an  alternative  is  identified  as  the  risk 
of  that  alternative  in  accordance  with  standard  statistical  terminology^. 

.1 

REQUIREMENTS 

As  a result  of  DT/CT-II  decisions  will  be  made  as  to  the  acceo tab i li tv 
of  the  entire  system  from  a reliability  viewpoint  and  on  each  of  the  four 
major  subsystems  from  a durability  viewpoint.  Therefore  reliability 
requirements  must  be  specified  for  the  total  system  and  durability  require 
ments  must  be  specified  for  each  major  subsystem.  It  was  assumed  that  a 
truncated  test  would  be  preferred  to  a fire  to  failure  test  for  planning 
purposes.  Therefore,  a maximum  number  of  rounds  to  be  fired  or  each  svstem 
truncation  point  mutt  bo  specified.  As  a total  system  configuration  is 
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required  to  conduct  the  test,  the  number  of  systems  to  be  put  on  test  must 
be  specified  along  with  the  number  of  spare  or  replacement  components. 

Also  since  statistical  techniques  produce  not  one  but  a family  of  alterna- 
tive statements  from  the  same  test,  the  confidence  level  associated  with 
the  test  must  be  specified.  Additionally,  each  reliability  and  durability 
requirement  must  be  specified.  Rejection,  fix  and  acceptance  region  were 
specified  by  the  pairs  (Rj  ,R2)  for  reliability  and  (D^  ,D2)  for  durability 
(defined  in  the  section  "Loss  Function").  Combining  the  above,  the 
following  set  of  requirements  must  be  specified  to  define  the  requirements 
and  statistical  test  environment  for  DT/OT-II. 


Sys  tem : 

Number  of  systems  on  test 
Reliability  acceptance  MTBF  - R i 
Reliability  rejection  MTBF  - R, 
Truncation  Point  - Tp 
Confidence  Level 


Subsystem : 

Number  of  spare  subsystems  - N 
Durability  acceptance  MTBF  - D, 
Durability  rejection  MTBF  - D2 


The  subsystem  requirements  must  be  specified  for  each  major  subsystem 
which  are:  the  carriage,  the  recoil,  the  tube  and  the  breech. 


QUANTIFICATION 


Research  scientists  and  design  engineers  were  interviewed  to  quantify 
their  expectations  regarding  durability  of  the  subsystems  under  their 
cognizance.  Reliability  expectations  were  developed  by  the  WECOM  Product 
Assurance  Directorate  based  upon  failure  and  stress  data  from  the  M102, 
105MM  Towed,  Howitzer  and  expected  stress  levels  and  failure  modes  of  the 
.'01204  . 

The  primary  technique  used  to  quantify  the  durability  of  the  subsystem 

was  presented  by  Stanford  Research  Institute  at  the  1972  US  Army  Operations 

Research  Symposium.  In  essence,  the  design  engineer  is  required  to  choose 
between  two  lotteries.  Lottery  No.  1 concerns  the  durability  of  the  sub- 
system. The  design  engineer  will  win,  say,  one  million  dollars  if  the 
durability  of  the  subsystem  will  be  demonstrated  less  than  X rounds  (X  is 
specified  by  the  interviewer).  Lottery  No.  2 concerns  the  spin  of  a 
pointer  on  a wheel.  The  design  engineer  will  win  one  million  dollars  if 
the  pointeL  fells  within  the  red  sector.  After  a choice  has  been  made  by 

the  interviewee,  the  red  sector  is  increased  or  decreased  with  the  object 

of  making  the  interviewee  indifferent  between  the  lotteries.  When  the 
indifference  has  been  obtained,  the  percentage  of  the  exposed  red  sector 
is  recorded  as  the  belief  of  the  interviewee  in  the  occurrance  of  the  event 
subsystem  durability  is  less  than  X rounds. 

P(durability  < X ] = % red  sector 

The  process  is  repeated  for  various  values  of  X until  a probability  distri- 
bution can  be  drawn.  Two  experts  were  interviewed  for  most  of  the  major 
subsystems  for  which  a durability  requirement  exists.  The  experts  were 
either  engineers  working  on  the  design  of  the  subject  subsystem  or  physical 
scientists  with  knowledge  of  the  subsystem. 
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assigned  to  the  midpoint  of  the  interval.  These  distributions  are  pre- 
sented in  Table  1 for  the  distribution  fit  to  the  data. 

TABLE  1 

PRIOR  DISTRIBUTION  ON  MEAN-SOUSDS-TO-FAILURE  PARAMETER 
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THE  LOSS  FUNCTION 

The  purpose  of  the  less  function  is  to  estimate  the  expected  losses 
(expenditures  which  will  occur  when  action  is  taken  in  accordance  with  the 
belief  that  the  state  of  the  system  is  S'  when,  in  fact,  it  is  S. 

The  contractually  specified  performance  parameters,  reliability  (R) 
and  durability  (D) , are  considered  to  be  bounded  by  military  necessity  or 
cost-effectiveness.  From  the  military  necessity  standpoint,  reliability 
can  be  translated  into  the  requirement  that  a battery,  fire  on  the  average, 
a specified  number  of  rounds  during  a mission.  A system  with  a lower 
reliability  will,  on  the  average,  fire  fewer  rounds.  Increasing  the  number 
of  systems  per  battery  will  achieve  this  goal  of  a ninimum-expected-nurober- 
of-rounds/battery/mission.  If  the  resulting  design  of  the  systems  does  not 
meet  the  specified  linits,  this  alternative  cun  be  used  as  an  upper  bound 
on  the  cost  of  the  second  alternative,  that  being  to  ".fix-up"  a marginal 
system.  In  all  cases  an  additional  alternative  is  to  cancel  the  program 
and  live  with  the  existing  system.  The  term  "fix-up"  as  used  here  means 
that  a reliability  growth  program  will  be  entered.  A sequence  of  design- 
test  cycles  will  be  conducted  until  the  reliability  is  grown  to  the  required 
lev  :1 


Similarly,  durability  is  a requirem''^ t on  the  life  of  a system.  Dura- 
bility r*n  we  translated  into  the  requirement  that  a system,  on  the  average, 
survives  a specified  number  of  rounds  before  requiring  an  overhaul,  or 
replacement  when  overhaul  isn’t  applicable  (i.  e.  , tubes).  A system  witr.  a 
lower  durability  will,  on  the  average,  survive  fewer  rounds  before  an  over- 
haul is  required.  The  cost  of  this  lower  than  desired  system  -iurabil  i tv 
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can  be  estimated  by  the  expected  increase  in  overhaul/maintenance  actions, 
over  a suitable  time  frame. 

Reliability  Loss  Function,  L(R,R*) 

Definitions : 

R - true  value  of  system  reliability 
R - statistical  estimate  of  R based  on  test  data 

R'  - if  R not  significantly  less  than  R2  (based  on  statistical 

test  of  hypothesis) 

= R if  R is  significantly  less  than  R2 

R - a value  of  R'  which  is  less  than  or  equal  to  Rj  is  cause  for 
system  rejection 

R - a value  of  R'  which  is  greater  than  or  equal  to  R2  is  cause 

for  system  acceptance  with  regard  to  reliability.  This  value 
is  viewed  as  a requirement  designed  to  insure  that  the  expected 
number  of  rounds  fired  by  a battery  in  a particular  mission 
will  not  be  below  a specified  level. 

L(R,R')  - is  the  costs  incurred  in  taking  a course  of  action  when 

R is  the  true  reliability  and  R’  its  estimate. 

Consider  a pair  (R1,R2)  to  be  defined  such  that  if  the  true  system 
reliability  R were  known,  the  following  actions  would  occur  (depending  on 
R): 

1.  R <_  R,  =*•  Action:  Reject  entire  system 

2.  R2  < R < R, . *>  Action:  Fix  - the  system  will  be  made  acceptable, 
by  entering  a reliaSility  growth  program  or  fielding  more  systems  per 
battery  to  insure  the  expected  number  of  rounds  criterion. 

3.  R,  < R >*•  Action:  Accept  the  sysrem  with  respect  to  reliability. 

Unfortunately,  the  value  of  R is  not  known.  Statistical  techniques  will 
provide  an  estimate,  R,  from  test  data.  This  value  will  be  compared  to  R2 
to  determine  if  R is  significantly  less  than  R2  on  a statistical  basis. 

If  the  test  does  not  show  a significant  difference  then  action  will  be 
taken  as  though  R'  >_  R2  , otherwise  we  will  take  action  as  though  R'  » R. 

Consider  the  reliability  decision  space  divided  into  three  regions 
as  shown  below. 

rejection  . fix  j accept 


The  actual  or  true  reliability,  R,  could  fall  into  anyone  of  the  three 
regions.  In  addition,  when  we  test  the  system  the  estimate  R'  could  also 
fall  into  anyone  of  the  three  regions.  As  we  increase  the  sample  iuu  of 
cur  test  Q ' shouiu  asymptotically  approach  R,  however,  the  cost  of  the 
test  wta  ’.so  increase.  As  we  lower  the  test  cost  or  reduce  the  sample 
size  then  ..ne  expected  difference  between  R and  R'  will  increase.  There- 
fore, there  are  nine  possible  states  that  could  occur.  They  are: 
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RR' 

Case  6 

R 

R' 
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R 

R' 

' — ' ] 
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i 

R 
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R 
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R' 

R 
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R 
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r 
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discussion 

outlines  a method  for  estimating 
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expected 

losses  incurred  for  each  of  the  three  possible  decisions  when,  in  fact,  R 
is  the  true  system  reliability.  The  nine  cases  as  outlined  above  are 
grouped  according  to  the  decision  that  is  made.  Contained  within  the 
discussion  of  each  case  are  several  cost  figures  which  are  referred  to  as 
C.,C-,C-,  etc.  The  definition  of  each  are  as  follows: 

C.  - The  cost  of  extending  the  life  of  the  present  (M1O2/M101A1) 
system  during  a new  development  program  (6  years) 

C_  - The  cost  of  a new  development  program 

C~  - Cost  of  procuring  and  operating  a second  generation  design 
during  the  remaining  planned  life  (14  years) 

C^  - Cost  of  the  planned  first  years  procurement 

C.  - Cost  of  a redesign  effort  to  correct  a jv  failure  mode 

C_  - Cost  to  procure  one  XX204 

CQ  - Cost  to  operate  and  maintain  one  XM2C4  over  20  years 

Decision: 

Accept:  j j RR1  •*  Case  9 

under  this  case  the  true  system  R is  acceptable  and  as  a result  of  the 
test  the  system  is  accepted.  The  correct  decision  is  made  and  the  only 
cost  incurred  are  the  cost  to  procure  and  the  cost  to  operate  the  weapon 
over  the  20-year  life  cycle.  The  cost  of  R failures  over  the  20-years  is 
based  on  the  actual  MRBF  of  the  system. 

L9(R,R')  =■  (C,+C<,)(No  of  Systems)  + (947 . 65)  (Total  Rnds)  / (MRB^) 

Accept:  ) R j R ' - Case  6 

Under  this  case  the  true  system  R lies  within  the  fixup  region  and  as 
a result  of  the  test  the  system  is  accepted.  An  incorrect  decision  was 
made  and  the  cost  associated  with  this  decision  are  as  follows.  Since  it 
is  thought  that  the  system  is  good  we  go  ahead  with  the  first  years  pro- 
duction. However,  after  the  first  years  production  it  is  assumed  that  it 
will  now  be  discovered  that  the  true  R is  uul  as  thought.  A pro- 

duct improvement  program  is  initiated  and  the  system  R is  grown  via  a 
redesign-test  cycle  until  the  true  system  R is  acceptable.  Now  since  one 
years  production  has  already  been  made  a retrofit  program  will  be  needed. 

To  cost  this  out  it  was  assumed  that  it  would  cost  a factor  of  two  times 
the  cost  of  an  ordinary  R growth  program  had  it  been  determined  (i.e.,  the 
right  decision  made)  before  the  first  years  production  was  made,  that  the 


L.(R,R')  = (C7+C0)(No  of  Systems)  + (2)(R  growth  cost) 

Accept:  R R 1 - Case  3 

Under  this  case  the  rue  system  R is  definitely  not  acceptable,  but 
as  a result  of  the  test  the  system  is  accepted.  An  incorrect  decision  was 
made  and  the  cost  associated  with  it  are  as  follows.  Since  it  is  thought 
that  the  system  is  good  we  go  ahead  with  the  first  years  production.  It 

is  assumed  that  it  will  now  be  discovered  that  the  true  system  R is 
definitely  unacceptable,  and  the  total  system  will  be  rejected.  The  cost 
of  the  first  years  production  will  be  lost  and  a new  development  program 
will  be  initiated.  The  present  system  will  have  to  be  maintained  and 
operated  during  the  new  de.velopment  program  which  is  assumed  to  last  six 
years,  per  AR  1000-1. 

L. (R , R ' ) = C,  + c + (C,)(No  of  Systems)  + C, 

Note:  It  is  assumed  that  as  a result  of  the  new  development  program 

the  new  system  will  meet  the  specified  MN  requirements  - This 
applies  to  all  cases  where  a new  development  program  is  entered. 

Reject:  RR'  , - Case  1 

Under  this  case  the  true  system  R is  unacceptable  and  as  a result  of 
the  test  the  system  is  rejected.  The  correct  decision  was  made.  A new 
development  program  will  be  entered  and  the  life  of  the  present  system  will 
be  extended.  In  addition,  the  cost  of  the  prototypes  and  test  cost  for  the 
first  design  will  be  lost. 

l^CR.R')  * Ci  + C7  + (C„)(No  of  Systems)  + Cost  of  Prototypes 

+ Test  Cost 

Reject:  R ’ | R , - Case  4 

Under  this  case  the  true  system  R lies  in  the  fixup  region.  As  a 
result  of  the  test  the  system  is  rejected.  Therefore  the  cost  described 
for  Case  1 are  incurred. 

L,  (R , R ' ) * C,  + C„  + (C,)(No  of  Systems)  + Cost  of  Prototypes 

4 i 2 j 

+ Test  Cost 

Reject:  R 1 ( j R - Case  7 

Under  this  case  the  true  system  R is  acceptable.  As  a result  of  the 
test  the  system  is  rejected.  Therefore  the  cost  described  for  Case  1 are 
incurred. 

L_(R,R')  3 C + C + (C  ) (No  of  Systems)  + Cost  of  Prototypes 

/ I 2 J 

+ Test  Cost 

Fixup:  t Rj i R - Case  8 

Under  this  case  the  true  system  R is  acceptable.  As  a result  of  the 
test  a R growth  program  is  initiated.  Funds  will  be  allocated  based  on  R1. 


It  should  soon  be  learned  chat  the  true  R is  acceptable,  but  since  the 
funds  have  been  allocated  the  growth  program  will  continue.  This  will 
increase  the  true  R which  will  lower  the  total  life  cycle  R cost. 

L9  3 (C7+C9 ) (No  of  Systems)  + Cost  of  R Growth  Program 
Fi't'JP;  R , R'  | ~ Case  2 

Under  this  case  the  true  R is  unacceptable.  As  a result  of  the  test 
a R growth  program  is  initiated.  The  funds  for  the  growth  program  will 
have  been  sunk  and  soon  it  will  be  realized  that  the  system  should  be 
rejected.  Consequently,  a new  development  program  will  be  started,  and 
the  cost  of  Case  1 will  also  be  incurred. 

L2(R,R')  = Cj  + C2  + (C , ) (No  of  Systems)  + Cost  of  R Growth  Program 
Durability  Loss  Function,  L (D ,D ' ) 


There  are  two  basic  differences  between  the  reliability  loss  function 
and  the  durability  loss  function.  The  first  is  that  there  are  durability 
requirements  at  the  subsystem  level  while  reliability  requriements  are  only 
at  the  system  level.  The  second  is  in  the  concept  of  fixing  a marginal 
system  for  reliability  vs.  accepting  an  increased  maintenance  burden  for 
durability. 

Definitions: 

D - true  value  of  subsystem  durability 
D - estimate  of  subsystem  D based  on  test 

D.  - a value  of  D'  which  is  less  than  or  equal  to  D.  is  cause  for 
subsystem  rejection  1 

D,  - a value  of  D'  which  is  greater  than  or  equal  to  D,  is  cause 
for  subsystem  acceptance  with  regard  to  durability 

D'  3 °2  d not  significantly  less  than  D2 

= D if  D is  significantly  less  than  D2 

For  each  subsystem  a pair  (D, ,D  ) will  be  defined  such  that  if  the  true 
subsystem  durability  D were  known  the  following  actions  would  occur 
(depending  on  the  value  of  D).  ’ 

1.  D < D t =*■  Action:  Reject  subsystem 

^ ‘ — D £ D,  ^ Action.  Fixup  - ihe- cost  incurred  to  maintain  the 

subsystem  at  D vs.  0..  will  be  used  as  an  upperbound  for  the  cost  of  this 
action. 

3.  D2  £ D Action:  Accept  subsystem,  plan  to  maintain  subsystem 

based  on  D,  being  the  true  durability. 


However,  the  value  of  D is  not  known.  Statistical  techniques  will  provide 
an  estimate  D from  test  data.  This  value  '•■ill  be  comDared  to  D to  deter- 
mine if  D is  significantly  less  than  D-  on  a statistical  basis. “ If  the 
test  does  not  show  a significant  diffp  ence  then  action  will  be  taken  as 
though  D’  £ D ; , otherwise  we  will  take  action  as  though  D1  - b . 
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Similar  to  the  reliability  decision  space,  the  durability  decision 
space  is  divided  into  three  regions  as  shown  below: 

Reject  | Accept/Marginal  Accept 

D,  D- 

As  with  the  reliability  the  true  durability  D could  fall  into  anyone  of  the 
three  regions  as  could  the  estimate  D'.  Therefore,  there  are  nine  possible 
states  that  could  occur.  There  are: 
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There  are  only  three  instances  where  the  decision  would  be  to  reject 
the  subsystem,  namely  Cases  1 , 4 & 7 . If  any  subsystem  is  rejected  then 
the  cost  incurred  are  the  same  as  those  that  would  occur  for  a reliability 
rejection.  A new  development  program  will  be  entered  and  the  life  of  the 
present  system  will  be  extended.  In  addition,  the  cost  of  the  prototypes 
and  the  test  cost  for  the  first  design  will  be  lost. 

L,  . _ (D ,D ' ) = C,  + C + (C  )(No  of  Systems)  + Cost  of  Prototypes 
1 - 1 - 

+ Test  Cost 

In  all  other  cases  the  subsystem  will  be  accepted,  however,  the 
expected  number  of  renewals  E[N]  (overhauls)  will  differ  depending  on  the 
decision  space.  For  Cases  2,3,6  & 9 the  expected  number  of  renewals  will 
be  calculated  based  on  the  true  mean  tine  between  durability  failure  D. 

For  Case  8 the  estimate  D1  will  be  used  to  calculate  the  expected  number 
of  failures.  And  for  Case  5 the  minimum  of  D and  D'  will  be  used. 

L,  (D,D')  = (E [N] ) (Cost/overhaul) (No  of  Systems) 

For  Cases  2,3,6  & 9 the  test  estimate  D'  is  the  mean  time  between  over- 
haul the  subsystem  is  thought  to  have.  Once  the  end  item  is  fielded,  the 
true  durability  D is  the  actual  maintenance  burden  that  will  be  exhibited, 
therefore,  the  expected  number  of  renewal  based  on  D is  the  true  cost.  It 
would  have  to  be  overhauled  at  D. 

For  Case  8 the  planned  overhaul  time  would  be  based  on  D'  and  since 
D > D'  it  will  not  be  possible  to  take  advantage  of  the  full  designed 
durability.  Therefore,  the  E[N]  is  based  on  D'. 

For  Case  5 the  calculation  of  E[N]  is  based  on  the  Min(D,D').  Tf 
D > D'  then  D'  will  be  used  as  for  Case  8.  If  D'  > D then  D will  be  used 
as  for  Cases  2,3,6  & 9. 

Total  Loss 


The  cotal  expected  cost  if  the  system  is  accepted,  is  the  sum  of  the 
reliability  and  durability  losses.  However,  if  any  subsystem  is  rejected 
for  durability  or  if  the  system  is  rejected  for  reliability  then  a total 


redesign  stage  is  entered.  It  is  assumed  that  no  matter  what  magnitude  of 
improvement  is  required  during  the  redesign  stage,  when  the  "new"  system 
is  tested  it  will  meet  all  MN  requirements  regardless  of  what  level  the 
requirements  are  set  at.  The  expected  number  of  durability  and  reliability 
failures  for  the  "new"  design  are  calculated  on  the  basis  of  the  MN  require- 
ments over  the  remaining  14  (20-6)  years. 

PARAMETER  SPACE 

The  procedure  adopted  for  pursuing  the  objective  of  the  study  was  to 
search  over  the  relevant  variables  and  choose  that  combination  which  yields 
the  lowest  expected  loss. 

Tne  system  reliability  requirement  for  the  XM20A,  states  a minimum 
acceptable  average  number  of  rounds  between  failure  (MRBF) . This  require- 
ment assumes  MRBF  to  be  constant  during  the  operating  life  of  the  system. 

A constant  MRBF  will  be  assumed  for  this  study  with  respect  to  reliability. 
Subsystem  durability  requirements  are  expressed  in  terms  of  a subsystem 
operating  no  less  than  a specific  number  of  rounds  with  a specified  proba- 
bility; e.g.  , 

Prob  (Subsystem  Life  > 500  rounds]  >_  .5 

A direct  searcn  with  acceleration  was  adopted  for  searching  the  para- 
meter spice  for  parameter  vectors  yielding  lower  expected  losses.  This 
routine  makes  steps  on  either  side  of  the  baseline  to  establish  a direction 
for  each  of  the  parameters  (variables  in  this  context)  and  takes  larger  or 
smaller  steps  in  the  established  direction  (constrained  by  a specified 
number  of  step  cuts),  until  not  further  improvement  can  be  made  in  the 
objective  function,  which  in  this  case  is  expected  loss. 

The  initial  baseline  reliabili ty/durability  validation  test  plan  and 
requirements  are  presented  in  Table  3.  The  test  of  hypothesis  confidence 
level  (Table  2,  A6)  pertains  to  the  test  conducted  on  the  statistic  under 
consideration.  (i.e.,  test  data  is  used  to  generate  a statistic  which 
estimates  durability,  say  D.  Is  D significantly  different  than  the  desired 
durability  D„? 

TABLE  2 

BASE  LINE  PARAMETERS 


A.  Test  Parameters 


T_  „ 

No. 

Carriage  Subsystems 

- 3 

2 - 

No. 

Recoil  Subsystems  - 

3 

3. 

No. 

Tubes  - 12 

4. 

No . 

Breech  Subsystems  - 

3 

5.  Truncation  Point  - 22,500 

6.  Test-of-Hvpothesis  Confidence  (Assumed)  - 90% 
3.  Reliability /'Durability  Parameters 

1.  Reliability  Rejection,  R,  = 1500 

2.  Reliabili  tv  Acceptance,  R-,  = R. 

3.  Durability  Rejection,  (0,0  ) 

a.  D,  (Carriage)  = 22,500 
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TABLE  2 CONTINUED 


b.  D.  (Recoil)  = 22,500 

c.  D'i  (Tube)  = 7,500 

d.  D-  (Breech)  = 22,500 

4.  Durability  Acceptance,  (D,,™) 

a.  D-,  (Carriage)  = Dj  (Carriage) 

b.  D„  (Recoil)  - Dj  (Recoil) 

c.  D,  (Tube)  = D^  (Tube) 

d.  D9  (Breech)  ■ Dj  (Breech) 


TEST  PLAN 

During  DT/OT  a certain  number  (N- ) of  howitzers  will  be  placed  on 
test.  For  testing  purposes  the  howitzer  is  composed  of  one  critical  sub- 
system (the  carriage)  and  several  major  non-critical  subsystems  (recoils, 
tubes  4 breeches).  Each  howitzer  will  be  fired  until  one  of  two  events 
occur : 

(1)  a carriage  durability  failure  occurs, 

(2)  a specified  number  of  rounds,  t , have  been  fired. 

P 

A maintenance  support  test  package  will  accompany  each  weapon  and  among  its 
contents  will  be  spare  prototypes  for  each  of  the  major  non-critical 
subsystems  (N0  - Recoil,  N9  - Tube,  - 3reech) . 

A total  system  configuration  is  required  to  conduct  the  test,  however 
with  respect  to  probability  of  failure,  each  subsystem  is  assumed  inde- 
pendent. During  the  course  of  the  test  as  each  non-critical  subsystem 
durability  failure  occurs,  the  failure  time  is  noted,  and  the  failed  sub- 
system is  replaced  until  either: 

(a)  all  of  the  spare  prototypes  of  type  k have  suffered  a durability 
failure , 

(b)  the  carriage  has  suffered  a durability  failure  or  has  fired  t^ 
rounds. 

If  all  of  the  spares  of  a particular  type  subsystem  have  failed  before  (1) 
or  (2)  above  occur,  then  that  subsystem  will  be  "pa tched-up"  to  allow  the 
test  to  continue  until  either  (1)  or  (2)  does  occur.  However,  no 
additional  information  will  be  collected  on  that  weapon  for  that  subsystem. 


When  a reliability  failure  occurs  for  any  subsystem  the  failure  time 
is  noted  and  the  failure  is  repaired  to  allow  the  test  to  continue.  The 
repair  will  be  assumed  as-good-as-new  and  each  reliability  failure  is 
assumed  independent. 


A hypothetical  design  and  observation  of  this  type  of  test  is  shown  in 
the  following  example: 

Examo  1 e 1 : 


Number  of  Carriages,  N-, 

Number  of  Recoi Is /carriage , N'~, 
Number  of  Tubes /carriage . N’- 
Number  of  Breeches /carriage , N 
tp  - 22,500  rounds 


3 

4 (original 
7 (original 
2 (original 


+ 3 spares) 
+ 6 spares ) 
+ 1 spare) 


h5u 


Tlie  above  cost  design  depicts  a test  where  three  howitzers 
will  be  fired  tor  a maximum  of  22,500  rounds  each.  Each 
carriage  has  three  spire  recoils,  six  spare  tubes,  and  one 
spare  breech  in  its  maintenance  support  test  package. 


Test  Observations 


Reliabilicv  Failures 

Durability  Failures 

Carriage  91 

3085,  5667,  1559a 

15597 

Recoil  •-/ 1.1 

8766,  10729 

No  observed  failure 

Tube  n.l 

6648 

Tube  9 1 . 2 

8823 

Tube  •/ 1 . 3 

14402 

Tube  1 . 4 

No  observed  failure 

.breech  91.1 

No  observed  failure 

Carriage  92 

8020,  1 '672 

No  observed  failure 

Recoil  92.1 

9166 

Recoil  92.2 

13587,  18173 

20293 

Recoil  92.3 

Mo  observed  failure 

Tube  92.1 

6822 

Tube  92. 2 

13339 

Tube  92.3 

20122 

Tube  '2 . 4 

No  observed  failure 

3reecii  -'2.1 

22498 

Carriage  93 

5552,  9229,  13178 

No  observed  failure 

Recoi 1 93.1 

1 1443 

H666 

Recoil  93.2 

16674 

Recoil  93.3 

22498 

No  observed  failure 

Tube  93.1 

7270 

Tube  93.2 

17924 

Tube  93.3 

No  observed  failure 

Breech  93.1 

No  observed  failure 

The  above  failure  times  are  ti.e  number  of  rounds  on  the  carriage  at  the 
time  the  failure  occurred.  Carriage  91  has  a durability  failure  at  1559’’ 
rounds  at  which  time  all  testing  was  stooped  on  that  weapon.  Testing  on 
Carriage  9 2 and  93  were  stopped  at  the  predetermined  truncation  point  of 
22,500  rounds. 

Associated  with  weapon  ;:1  were  five  reliability  failures  which 
occurred  at  the  times  shown.  Three  of  the  reliability  failures  occurred 
on  the  carriage  and  two  occurred  on  the  recoil.  The  original  recoil  did 
not  'nave  a durability  failure  and  lasted  until  the  carriage  failed  or  15597 
rounds.  The  original  tube  was  replaced  at  bo^d  rounds,  the  first  snare  was 
replaced  8823  rounds,  and  the  second  spare  was  replaced  at  19402  rounds. 

The  last  tube  did  not  fail  in  the  remaining  1195  rounds.  The  original 
breech  survived  the  15597  rounds. 

Test  Statistics 

The  observations  as  outlined  in  Example  1 were  generated  from  the  two 
parameter  Neibull  distributions  as  shown  below.  Along  with  the  true  values 
are  shown  the  estimates  which  are  based  on  the  observations. 
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T rue 


Estimate 


Carr iage 


Shape  parameter  = 
Scale  parameter  = 
with  MTBF  = 


Recoil 

Shape  parameter  = 
Scale  parameter  = 
with  MTBF  = 


Tube 


Shape  parameter  = 
Scale  parameter  = 
with  MTBF  = 


Breech 

Shape  parameter  = 
Scale  parameter  = 
with  MTBF  = 


Shape  parameter  = 
Scale  parameter  = 
with  MTBF  - 


2 . 48h42 
.449008  x 10" 
31,613  rounds 


1.21277 
.487712  x 10" 
17,728  rounds 


1.995004 
.3712387  x 10 
5,164  rounds 


1.911326 
.7511622  x 10 
5,325  rounds 


.26666  x 10 
3,750  rounds 


a = 3.1584b 
X = .775047  x 10" 
p = 26,152  rounds 


a = 2.05138 
X - .379892  x 10 
p = 10,644  rounds 


a = 2.833641 
X = .1150474  x 10 
p = 6,371  rounds 


X = .28058  x 10 
p = 3,564  rounds 


Consider  the  following  as  the  requirements  for  the  test 


D. 

i 

3, 

S3 

1 

R, 


Carriage 

Recoil 

Tube 

Breech 

Reliability 

11.000 

8,000 

5,000 

15,000 

22,500 

22,500 

7,500 

22,500 

1,790 

3,795 

then  based  on  the  test 


results  the  following  decision  would  be  made. 


Durability 

Carriage  - Accept  - Case  9 
Recoil  - Accept  - Case  5 
Tube  - Accept  - Case  5 
Breech  - Accept  - Case  3 
Reliability  - Fixup  - Case  6 


RECOMMENDATION'S 


In  accordance  with  the  definitions  prescribed  within  this  report,  the 
following  table  outlines  the  "optimized"  results  of  the  simulation. 


456 


TABLE  3 


Tost  Description 

N.  - Number  of  Prototypes  to  be  put  on  Test  - 3 
N . - Number  of  Spare  Recoi Is /Pro tc types  - 5 
N/  - Number  of  Spare  Tubes/Procotypes  - 13 
N.  - Number  of  Spare  Breeches/Prototypes  - 3 


Max 

Number 

of 

Rounds  to  be 

Fired /Prototypes  - 

20,000 

Conf idence 

Level  for  Test 

of  Hypothesis  - 90% 

Requirements 

Carriage 

r. . 

**  i 

- 

13,500 

Breech  D, 

7,500 

D„ 

21,000 

°2  " 

16,000 

Recoil 

D. 

- 

6,000 

Reliability  R, 

400 

d‘ 

10,500 

*2 

- 1,500 

Tube 

D, 

- 

* 

D, 

- 

* 

*No  Recommendation,  See  Section  "Sensitivity  and  Conclusions 


With  the  above  test  description  and  requirements,  the  expected  total 
test  cost  is  $6,423,010.80  which  can  be  broken  down  into  $3,751,500  for 
prototype  cost  and  $2,671,510.80  for  ammunition.  Other  expected  values 
associated  with  the  simulated  test  are  shown  below  in  Table  4. 


Samp 1 e S i 2 £ 

E(N  ] 


= 500 

Carriage  Failures  During  the  Test  = .948 


E ( N ] Recoil 

Failures/Carriage  = 5 

O'- 

OO 

£[N  ] Tube  Replacements/Carriage  = 

8. 

494 

E[N  ] Breech 

Failures/Carriage  =*  . 

144 

Number 

of 

Occurrences 

for 

Each 

Case 

* 

Case  Mo.  1 2 

3 

4 5 

6 

7 

8 

9 

Carriage  Durability 

50  2 

15 

1 0 

27 

0 

2 

403 

Recoil  Durabilitv 

149  0 

10 

11  1 

* “ 

2 

4 

268 

Tube  Durability 

- 

- 

- 

- 

- 

- 

Breech  Durability 

0 0 

0 

6 1 

1-, 

1 

0 

365 

System  Reliability 

0 0 

0 

0 0 

136 

0 

2 

250 

*Sea  Section  "Loss  Function"  for  definition  and  explanati 

on  of 

each  case 

Probabi 

lit”  of  Not  Rejecting 

System  at  DT/OT-II 

Carriage  Durability 

- 

37.6  Z 

Recoil  Durability 

71.4% 

Tube  Durability 

- 

- 

Breech  Durability 

99.0% 

System  Reliability 

100. 0% 

TOTAL  SYSTEM 

61% 

Expected  Total  2 

0 year  life  cycle  cos 

t = 

$6,223,908. 

,800. 

00 
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SENSITIVITY  AND  CONCLUSIONS 

A sensitivity  analysis  was  conducted  by  varying  the  input  probability 
distribution  for  each  subsystem  and  system  reliability  as  outlined  in  the 
section  "Quantification  of  Performance  Uncertainties."  The  difference  in 


the  total  20  year  life 

cycle  cost  as  compared  to 

the  "optimized  case"  are 

shown  below. 

Subsystem 

Direction 

Difference  ($  x 10  ) 

Carriage 

Pessimis  tic 

+ 

.991 

Optimistic 

- 

2.789 

Recoil 

Pessimistic 

+ 

2.6414 

Optimistic 

- 

2.7834 

Tube 

Pessimistic 

+ 

31.9099 

Optimistic 

- 

6.5098 

Breech 

Pessimistic 

+ 

5.1265 

Optimistic 

- 

2.3168 

Reliabili ty 

Pessimistic 

+ 

.6303 

Optimistic 

- 

7.2014 

The  estimate  of  the  standard  deviation  j 

for  the 

total  life  cycle  cost,  due 

to  random  occurrence  i 

s ' $1.3846  :<  10°, 

therefore  2o  = 2.7692  and 

3c  = 4.1538  x 106. 


Since  the  tube  showed  the  highest  vari  bility  and  was  considerably 
outside  the  3c  range  it  was  decided  to  furthet  study  the  tube  durability 
requirements.  Holding  all  other  parameters  at  th.  "optimize"  values,  the 
parameters  Dj  and  D.  for  the  tube  were  varied  with  the  following  results. 

Life  Cycle  Cost 

D,  = 02  = 1,000  6.647478  x 109 

Dj  = D2  - 3,000  6.313495  x 109 

D;  - D,  = 5,000  6.254015  x 109 

Dj  = D~  = 7,500  6.243281  x 109 

Dj  = = 10,000  6.238615  x 109 

In  each  of  the  above  outcomes,  the  life  cvcle  cost  was  based  on 
replacing  the  tube  at  D~  rounds.  Since  there  was  almost  no  risk  associ- 
ated with  building  a tube  that  would  last  1,000  cr  3,000  rounds  and  the 
difference  in  total  life  cycle  cost  is  above  $300  million  there  is  no 
reasons  not  to  demand  the  3,000  round  tube.  Similarly,  a $59  million 
savings  can  be  expected  with  only  a 411  probability  of  rejection  increase 
by  requiring  a 5,000  round  tube.  As  the  durability  requirement  is  increased 
to  7,300  and  10,000  the  percentage  of  savings  vs.  the  increased  probability 
of  rejection  makes  one  question  the  advisability  of  d nanding  these  higher 
requirements.  Since  the  simulation  considers  a $1  savings  just  as  important 
as  a $1  billion  dollar  savings  in  its  effort  to  optimize  and  in  addition  it 
was  assumed  that  the  state-of-the-art  was  no  barrier;  the  simulation  forced 
the  recommended  durability  values  for  the  tube  to  the  upper  boundary  set  in 
the  simulation.  Realizing  that  the  state-of-the-art  would  be  a barrier  at 


Probability  of  Acceptance/ 
Without  Redesign 

100% 

99.9% 

95.6% 

59.2% 

27.6% 


these  high  levels  one  additional  sensitivity  run  was  made.  The  program 
test  logic  was  changed  to  ignore  any  tube  requirements  and  the  life  cycle 
cost  was  calculated  based  or.  replacing  the  tube  at  whatever  wearout  life 
could  be  designed  for  each  iteration.  (This  would  be  similar  to  using 
pull-over  guages.)  This  resulted  in  a total  life  cycle  cost  of  6.2239  x 109 
which  was  even  less  when  D2  = 10,000  rounds.  In  an  effort  to  explain  this 
outcome  consider  the  following  three  cases. 


The  curve  represents  the  prior  probability  density  of  the  expected 
tube  durability  parameter.  D.  and  D,  define  the  acceptance,  fix  rejection 
region  defined  earlier  (See  Loss  Function).  Assume  the  probability 
density  curve  is  the  same  for  all  three  cases. 

In  Case  1 the  rejection  region  is  inconsequential  in  contribution  to 
the  expected  loss.  The  acceptance  region  is  la-ge,  but  the  longer  dura- 
bility life  is  not  consider-d  as  tube  replacements  are  based  on  the 
acceptance  requirement  D2  (S  e Loss  Function  Case  9).  In  Case  2,  the 
acceptance  region  is  incotsec aential . The  rejection  region  is  high  in 
probability  causing  frequent  rejection  of  the  system  with  resulting 
expenditures  in  development  ot  a system  that  meets  the  specified  require- 
ments, Dj,  for  all  subsystems;  and  additional  testing  funds  to  validate 
these  requirements. 

Case  2 was  preferred  to  Case  1 as  the  additional  expenditures  produce 
high  durability  while  much  of  the  predicted  durability  would  not  be 
utilized  under  Case  1. 

Case  3 was  preferred  to  Case  2:  Again  D > D2  occurs  with  small  pro- 

bability. D.  < D c D-.  results  in  expend! tor es  which  are  approximately  the 
same  for  Cases  2 and  3.  If  D < Dj  then  Case  3 replaces  tubes  based  on  test 
estimates  of  durability  avoiding  the  waste  incurred  by  Case  1 and  the 
expense  of  a new  development  program  recommended  in  Case  2. 

These  recommendations  are  sensitive  to  the  predicted  estimates  on  tube 
durability.  A pessimistic  prediction  of  tube  wear  leads  to  a recommendation 
of  Case  2 over  Case  3. 

The  conclusions  of  this  analysis  are: 

1)  Expected  loss  is  highly  dependent  on  tube  durability. 

2)  Sufficient  tube  testing  should  be  performed  to  establish  tube 
durability  rather  than  base  replacements  on  requirements. 

3)  Attainment  of  higher  tube  life  is  a basis  of  rejecting  the  pro- 
gram according  to  the  logic  of  the  simulation.  A more  realistic  action 
would  be  initiation  of  a program  to  achieve  a state-of-the-art  tube. 
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4)  A study  should  be  initiated  after  test  to  evaluate  the  durability 
of  the  tube  compared  to  the  state-of-the-art.  A study  similar  to  this 
should  be  performed  to  determine  benefits  to  be  derived  from  accepting  the 
tested  tube  design  or,  alternatively  proceeding  with  a tube  development 
program . 

5)  No  decision  regarding  a tube  durability  requirement  should  be  made 
at  this  time  in  view  of  the  sensitivity  of  this  parameter. 

For  the  carriage,  recoil  and  breech  durability  the  "D"  values  as  shown 
in  the  "RECOMMENDATIONS"  section  represent  the  recommended  design  goals  or 
acceptance  for  each  subsystem.  The  sensitivity  analysis  conducted  by 
varying  the  prior  probability  distribution  for  each  subsystem  show  that  if 
the  designers  risk  profile  were  in  error  up  to  25%  in  either  direction,  the 
difference  in  the  total  expected  loss  is  still  close  to  the  variability  of 
the  simulation  and  therefore  the  results  are  not  overly  sensitive  to  these 
inputs  within  the  ±25%  bands.  The  analysis  of  the  simulation  indicates  that 
the  reduced  maintenance/replacement  cost  that  would  result  by  raising  the 
D2  values  does  not  offset  the  expected  increase  in  loss  due  to  the  increased 
probability  of  system  rejection  and  the  associated  redesign-retest  and 
related  cost. 


The  Dj  values  represent  the  minimum  acceptable  durability  values.  Any 
subsystem  design  which  falls  below  these  values  should  be  rejected.  Below 
these  points  the  combination  of  redesign  cost,  retest  cost,  probability  of 
rejection,  and  cost  of  continuing  the  present  system  are  favorable  as  com- 
pared to  the  increased  maintenance/replacement  cost  that  would  be  incurred 
by  fielding  a weapon  system  with  these  low  values. 

For  system  reliability  the  R2  value  represents  the  design  goals  and  the 
reliability  value  at  which  the  system  should  be  fielded.  The  Rj  value 
represents  the  lowest  value  for  which  it  would  be  advantageous  to  enter  into 
a reliability  growth  program  and  grow  the  system  reliability  to  R2.  (This 
is  based  on  a "Duane"  growth  model  with  a slope  of  .523.)  An  analysis  of 
the  simulation  indicates  that  this  growth  slope  is  extremely  optimistic  and 
that  a more  realistic  growth  model  needs  to  be  developed  before  any  recom- 
mendation can  be  made  on  the  value  for  Rj . If  the  system  reliability  falls 
below  R,  then  the  system  should  be  rejected  and  a complete  redesign  effort 
should  be  initiated.  Until  a more  realistic  growth  model  can  be  incorporated 
into  the  simulation,  it  is  recommended  that  reliability  level  presently 
exhibited  by  the  M102,  105MM  Howitzer  system  be  used  for  R, , i.e.,  400  rounds. 


